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Method for generating a security document 

The present invention relates to a method for 
generating a security document and to a security document 
5 obtained by this method according to the preamble of the 
independent claims. In particular, it relates to the 
field of security printing, and more particularly it re- 
lates to anti-counterf eiting measures for identity docu- 
ments showing a photograph of their holder. 

10 Many identity documents bear a photograph of 

the document holder, because this photograph offers a 
convenient way of relating the document to its owner. The 
development of plastic card printers and the advances in 
digital imagery have lead to the widespread use of iden- 

15 tity documents printed on plastic cards, such as ID 
cards, driving licenses and access key cards. 

With the advance of color printers and copi- 
ers, it has become easy to forge such documents unless 
they are provided with security features, such as digital 

20 watermarks, microscopic text, etc. Such security features 
are, however, difficult to apply or to verify and they 
often impair the overall appearance of the document. 

The problem to be solved by the present ap- 
plication lies therefore in avoiding at least part of 

25 these advantages. This problem is solved by the independ- 
ent claims . 

Hence, at least some of the points of the 
original image are modified by changing their color. The 
change of color is a function of the original color C-j_ j , 

30 of the value p-^j of a security pattern as well as of a 

local average of the pattern. By using a function that 
depends on a local average of the pattern, it becomes 
possible to generate very flexible security markings that 
take the pattern's features into account. The protected 

35 image is difficult to imitate by using commercial image- 
processing packages because the changes in the protected 
image do not occur along a fixed direction of the color 
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space, but vary according to the color of the original 
image pixels and the averages of the security pattern. 

The embedded pattern can e.g. be textual in- 
formation already present elsewhere on the document, or 
5 it can be a code derived from data specific to the docu- 
ment holder. The protection can be made fully apparent, 
partly apparent, or completely invisible under normal 
viewing conditions. 

In a preferred aspect of the invention, a 

10 chromatic shift is given for any color of the original 
image. This shift is defined by the two colors that are 
used when the pattern value takes its minimum and maximum 
values. In this case, the function f can e.g. consist of 
a linear interpolation between the two colors of the 

15 chromatic shift. 

The chromatic shift can be derived from a 
reference shift at one specific color K. Preferably, a 
correcting offset is applied to this reference shift for 
balancing it according to the local average oc^ of the 

20 pattern. The chromatic shift can be calculated by cor- 
recting the luminance, hue and saturation of the refer- 
ence shift (or the corrected reference shift) . A further 
possible correction adjusts the values of the chromatic 
shift to make its CIE-Lab luminance difference equal to 

2-5 the one of the reference shift, which results in a uni- 
formly bright pattern for any original color value. 

The protected image is difficult to reproduce 
through photo-mechanic means such as a photocopying de- 
vice, because the chromatic shifts it contains can be 

30 specified as quasi-metameric pairs of colors. Either the 
pairs of colors are perceived as identical by the device 
and the embedded information is completely lost, or the 
pairs of colors are perceived as being more different 
than they really are and the embedded information becomes 

35 much more visible under normal light than it is in the 
protected image . 
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Identity documents containing images with em- 
bedded text are even more difficult to forge, because the 
embedded text can contain an encrypted version of the 
personal information present elsewhere on the document. 
5 Without knowledge of the process used for encrypting the 
text, it is impossible to adapt an existing document to a 
fake identity by replacing the photograph and the per- 
sonal information . 

The invention is especially suited for mark- 
10 ing identity documents, such as driver's licenses. 

Further preferred features and embodiments 
are described in the dependent claims as well as in the 
description, which makes reference to the figures. These 
show: 

15 Fig. 1 a single character and its correspond- 

ing gray level (top row) as well as the equality of two 
areas having the same local average, 

Fig. 2 the LEF color space, 

Fig. 3 a bitmap pattern for a given string, 
20 Fig. 4 the calculation of the average value 

for a letter bitmap, 

Fig. 5 the balancing of the reference shift, 
Fig. 6 the assembly of a text into its pat- 
tern, 

25 Fig. 7 the repetitive arrangement of the pat- 

tern of Fig. 6, 

Fig. 8 the repetitive arrangement of the pat- 
tern of Fig. 7, 

Fig. 9 the staggering of the pattern on Fig. 

30 8 , 

Fig. 10 the individual balanced reference 
shifts of differing letters, 

Fig. 11 the horizontal interpolation of the 
reference shifts, 
35 Fig. 12 the vertical interpolation of the 

reference shifts, 

Fig. 13 the luminance correction, 
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Fig. 14 the hue correction, 
Fig. 15 the saturation correction, and 
Fig. 16 the overflow correction. 
A preferred embodiment of a method that pro- 
5 tects identity documents by embedding text into photo- 
graphs is described hereafter. The method consists of the 
following basic steps: A reference chromatic shift (the 
"reference shift") is specified in a linear color space. 
Each character of the text to embed is rasterized into a 

10 bitmap. The reference shift is corrected for obtaining a 
coverage-balanced chromatic shift ("corrected chromatic 
shift") derived for each rasterized character according 
to the ratio between the surface occupied by black pixels 
(foreground) and the surface occupied by white pixels 

15 (background), i.e. according to a local average of the 

security pattern. The rasterized character string is re- 
peated horizontally and vertically to form a security 
pattern. A pattern-relative chromatic shift is interpo- 
lated between the coverage-balanced chromatic shifts of 

20 the neighboring bitmap characters for each pixel in the 
security pattern. A chromatically shifted color is ex- 
trapolated from the pattern-relative chromatic shifts for 
each pixel of the original image. The protected image is 
generated and output on a continuous- tone printer. De- 

25 pending on the size and orientation of the reference 

chromatic shift, the embedded text in the protected image 
can be visible or invisible under normal viewing condi- 
tions . 



30 Chromatic shifts: 

A "chromatic shift" is defined as a set of 
three colors C, Cfc> and Cf such that a surface of unitary 
area colored with C is visually equivalent to the same 
surface split in two foreground and background parts of 

35 area a, resp. 1 - a, with the foreground having color Cf 
and the background having color C^ (Fig. 1). Mathemati- 
cally, the colors of a chromatic shift must verify the 
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relation C = a Cf + (1 - a) C^. C represents the refer- 
ence color, Ck represents the reference background color, 
and Cf represents the reference foreground color. 

An additive color space is used for specify- 
ing the colors of a chromatic shift. Preferably, this 
color space is obtained by a linear transformation of the 
cube formed by the RGB space. The transformation and its 
inverse are defined by the following equations: 
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After transformation, the RGB cube stands on 
its black corner (Fig. 2). Its black-white axis is verti- 
cal and becomes the L-axis in the newly defined LEF color 

15 coordinate space. The two other E and F orthogonal axes 
are lying in the plane perpendicular to the L-axis 
through point L = 0 (the EF-plane) . The E-axis goes 
through the projection of vertex R of the RGB cube on 
plane EF . The vertical L component can be assimilated to 

20 the achromatic value of a given color, i.e. its luminance 
level. The E and F components convey the chromatic infor- 
mation pertaining to that color. 



Choosing the reference shift: 

25 The reference shift {K, K^, Kf} for an arbi- 

trary color K is specified by an interactive color pick- 
ing application according to N. Rudaz, R. D. Hersch, V. 
Ostromoukhov, Specifying color differences in a linear 
color space (LEF), Proceedings of the IS&T/SID 97, 

30 Scottsdale, 1997, pp. 197-202. 
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Creating a partial security pattern: 
The string of characters forming the text to 
embed into the image is converted into a bitmap image 
through the use of a font rendering software component 
5 such as the FreeType engine described at the URL 
http : / /www. f reetype . org/intro .htm. 

The font rasterizer creates a rectangular 
bitmap for each character in the string of text (Fig. 3), 
which will form part of the security pattern. 

10 

Local averaging: 

In the case of a binary bitmap, local aver- 
ages oc^, defined as the black coverage percentage, are 
calculated for each character bitmap, lies between 0 

15 and 1; it is defined as the ratio between the number P]^ 

of foreground pixels and total number of pixels or, in 
other words, if a pattern value pj_j of 1 is assigned to 
the foreground pixels and a pattern value p^j of 0 to the 
background pixels, ct^- corresponds to the average of the 

20 pattern values (Fig. 4) . 

Correcting the reference shift: 
A coverage-balanced chromatic shift {K, K^' , 
Kf'} is derived from the reference shift {K, K^, Kf} for 
25 each character bitmap. The chromatic distance D = Kj^ - Kf 
is computed. An offset d is derived from D using the re- 
lation 

d = D-(cc k - (p m ax ~ Pmin) / 2 > / <Pmax " Pmin> • 
wherein p m i n and p max are the largest and smallest possi- 
30 ble pattern values (for binary patterns we usually have 

Pmax = 1 and Pmin = °> • 

This offset d is added to and to Kf in 
order to obtain K^' and Kf ' (Fig. 5) : 

K b' = K b + d, (2) 
35 Kf' = Kf + d 

The resulting coverage-balanced chromatic 
shift {K, K^ , Kf'} exhibits the property that, if the 
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white pixels of the associated character bitmap are col- 
ored with K^' and the black pixels with Kf ' , then the av- 
erage color of the character bitmap is equal to K. 

5 Generating the security pattern: 

The rasterized characters are horizontally- 
juxtaposed into a rectangular tile (Fig. 6). This tile is 
horizontally repeated side by side as many times as nec- 
essary in order to produce a second bitmap with the same 

10 width as the original image (Fig. 7). The second bitmap 
is vertically replicated side by side as many times as 
necessary in order to produce a third bitmap image with 
the same height as the original image (Fig. 8). At each 
vertical repetition, the second bitmap is shifted hori- 

15 zontally in order to avoid disturbing optical artifacts 
that appear when characters are vertically aligned in a 
text. After the horizontal shift, the portion of the sec- 
ond bitmap that goes beyond the horizontal boundaries of 
the original image is wrapped around (Fig. 9) . This third 

20 bitmap is referred to as the security pattern and consti- 
tutes an image of the text that will be embedded into the 
original image . 

Calculating the pattern-relative chromatic shifts: 
25 A pattern-relative chromatic shift is com- 

puted for every pixel of the security pattern, based on 
the coverage-balanced chromatic shifts associated with 
the character bitmaps. 

In a first step, every pixel of the security 
30 pattern that is located at the center of a character 

bitmap is associated with that bitmap's coverage-balanced 
chromatic shift (Fig. 10) . 

In a second step, every pixel of the security 
pattern that is located on a horizontal line segment 
35 joining two centers of the character bitmaps is associ- 
ated with a pattern-relative chromatic shift that is ob- 
tained by linear interpolation between the coverage- 



8 



balanced chromatic shifts associated with these two cen- 
t 

ters (Fig. 11) . 

In a third step, every pixel of the security 
pattern that is located on a vertical line segment join- 
ing two pixels processed during the second step is asso- 
ciated with a pattern-relative chromatic shift that is 
linearly interpolated between the pattern-relative chro- 
matic shifts of these two pixels (Fig. 12). 

In a fourth step, every pixel of the security 
pattern that has not been processed during the previous 
steps is associated with the pattern-relative chromatic 
shift of its nearest neighbor. 

Calculating the chromatic shift: 
Each pixel in the security pattern is associ- 
ated with a pixel having the same coordinates in the 
original image. The pattern-relative chromatic shift un- 
dergoes a geometrical transformation in the LEF color 
space, with the purpose of adapting its background and 
foreground colors (K^' and Kf ' ) , so that the color re- 
sulting from the average of the adapted background and 
foreground colors is equal to the color C^j = (Lo E C' 
Fq) of the associated original pixel. 

In a first step, the luminance of the chro- 
matic shift is corrected according to the luminance dif- 
ference between the reference color K and the color Ci j . 
For this purpose, the luminance difference ALq K between 
Cij and K = (L K , E K , F K ) is computed using the relation 

A ^CK = L C ~ L K' < 3 ) 

and this luminance difference is added to K' , K^' and Kf ' 
in order to obtain the colors K' ' , K^' ' and Kf ' ' (Fig. 
13) . 

In a second step, the hue of the chromatic 
shift is corrected according to the hue difference be- 
tween the reference color K and the color j . For this 
purpose, the angular hue difference (AH^k) between C and 
K' ' is computed using the relation 
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AH CK = Tan (Arctan (F c /E c ) - Arctan ( F K ' ' /E K ' ' ) ) , (4) 
and this angular hue difference is added to K' ' , K^' ' and 
Kf'' in order to obtain the colors K' ' ' , K^' ' ' and Kf ' ' ' 
(Fig. 14) . 

5 In a third step, the saturation of the chro- 

matic shift is corrected according to the saturation dif- 
ference between the reference color K and the color Cj_ j . 
For this purpose, the saturation difference (AS^^) be- 
tween C and K' ' ' is computed using the relation 

10 AS CK = sqrt((F K "' - E c ) 2 + (E K "' - E c ) 2 ), (5) 

and this saturation difference is added to K B ' ' ' and 
Kp' ' ' in order to obtain the colors and Cf (Fig. 15) . 

In a fourth step, the CIE-Lab luminance dif- 
ference between C£> and Cf is adjusted so that it is equal 

15 to the CIE-Lab luminance difference between and Kf 
while maintaining the balanced average of C^ and Cf at 
color Cij 

In a fifth step, the colors C^ and Cf are ex- 
amined to see if they fit in the RGB color space. If this 
20 is not the case, the distance between C^ and Cf is pro- 
portionally reduced until both colors fit entirely into 
the RGB space (Fig. 16). 

Applying the chromatic shift: 
25 In a sixth step, the value pj_j of the secu- 

rity pattern pixel associated with the original image 
pixel is examined. If this pixel is white (e.g. corre- 
sponding to p^j = 0) , and therefore belongs to the back- 
ground of the security pattern, then the color C^ is as- 
30 signed to the pixel of the original image. If this pixel 
is black (pj_j = 1) , and therefore belongs to the fore- 
ground of the security pattern, then the color Cf is as- 
signed to the pixel of the original image. In general, 
for non-binary security patterns, the new color Cj_ j ' is 
35 calculated from 

Cij' = C b (C i: j) - (Pij " Pmin) / (Pmax ~ Pmin> + < 6 > 
C f (Cij ) * (P m ax ~ Pij)/(Pmax ~ Pmin) * 
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where p m j_ n and p max are the minimum and maximum possible 
pattern values p^ j . 

Printing the modified image: 
5 The modified image is output on a continuous- 

tone printer such as a dye-sublimation printer. Dithering 
devices that apply halftone screens on the images they 
print, such as laser printers or ink- jet printers, are 
not suitable for printing the protected images because 
10 the dithering process alters the structure of the embed- 
ded text . 

Detection of the embedded text: 

If the reference shift {K, K^, Kf} presents a 
15 large enough contrast, the embedded text is readable un- 
der normal viewing conditions. Conversely, if the refer- 
ence shift {K, Kb, Kf} presents a weak contrast, the em- 
bedded text is invisible and a close inspection or image 
analysis is required in order to read it. 

20 

Remarks : 

The order of the various steps described 
above can be changed. In particular, the average values 
can be calculated after the security pattern of Fig. 9 
25 is generated, and the steps for correcting the luminance, 
hue and saturation of the color shift are interchange- 
able . 

The local averages have been calculated as 
the averages over the individual characters of the secu- 

30 rity pattern. It is, however, also possible to use other 
averaging techniques. In particular, the security pattern 
can be processed by a low pass filter, where each point 
is e.g. replaced by a weighted average of itself and a 
number of neighboring points . 

35 As already indicated, the security pattern 

may be non-binary and can e.g. consist of various gray 
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levels, such as the may be used for representing anti- 
aliased characters . 

In more general terms, the method described 
here starts from an original image and a security pat- 
5 tern. It calculates local averages ot k of the values p-j_j 
of the security pattern, e.g. by averaging over the 
bitmap of one character or by running the security pat- 
tern through a low pass filter or by using interpolation 
techniques of averaged values such as described by refer- 

10 ence to Figs. 11 and 12. In particular, the local average 
oc k of an area k can e.g. be calculated from 

a k = X A k# ij -pij (7) 
wherein A k is a matrix of weights and X is the sum over 
the points with indices i,j in said area k. In the exam- 

15 pie above, the area k corresponds to one character bitmap 
and A k/ i j = 1/N k , wherein N k is the number of points in 
said area . 

For at least some of the points of the origi- 
nal image, the color Cij of the original image is re- 

20 placed by a color C'ij using a function f: 

C'ij = f (Cij , pij , a k ) , 
wherein the function f depends on at least one local av- 
erage a k of an area k said point Pij is located in. 

Preferably, f should have the property that 

25 if m and M are real numbers with m < oe k < M, and wherein 
C m = f(Cij, m, a k ) and C M = f(Cij, M, a k ) , and if Cij 
lies within a color space with a Euclidean metric and we 
define R m as the Euclidean distance between C m and Cij 
and R M as the Euclidean distance between C M and Cij , then 

30 for any value Pij in the interval [m, M] , the Euclidean 
distance between Cij and f(Cij, Pi j , a k ) lies within the 
interval [0, max(R m , R M ) ] . In addition to this, f (if de- 
fined in analytic form) should by continuous. 

In other words, for pattern values that are 

35 close to the local average, f should be such that the 

color of the original image is changed only slightly. In 
this way, the appearance of the protected image remains 
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globally identical to the appearance of the original im- 
age . 

If an averaging technique according to Eq. 
(7) is used, f is preferably such that 
5 £ (A k/i j-f(C, pij, a k ) ) « C. (8) 

This again ensures that the average color of a given lo- 
cal area k of the modified image is equal to the average 
color of the same area of the original image. 

Function f can be implemented algorithmi- 

10 cally, e.g. by providing a chromatic shift for any given 
color Cj[j and any local area k. The chromatic shift is 
given by two colors C^C^-j) and Cf(Cj_j), wherein the 
function f depends on said coverage-balanced chromatic 
shift in such a way that 

15 f(C, p m i n , a k ) = C b (Cij) and 

f(C, Pmax' <* k ) = Cf(Cij), 
wherein p m i n and p max are minimum and maximum possi- 

ble pattern values Pi j . Between these values, f can e.g. 
be calculated by linear interpolation. 

20 For calculating the chromatic shift for a 

given color j , various methods can be used. As de- 
scribed above, it is e.g. possible to provide a reference 
shift for one reference color K. The reference shift is 
given by two colors and Kf, wherein K, and Kf lie 

25 on a single line in an Euclidean additive color space and 
K is located in the center of and Kf . The reference 
shift corresponds to the chromatic shift for color C-^j if 
Cj_j = K and a k = (p ma x + Pmin)/ 2 - The reference shift can 
then be balanced e.g. using Eq. (2) above. Then, depend- 

30 ing on the position of the colors K and C±j , the values 
Cb(Cj_j) and Cf (C^-j) can be derived by correcting hue, 
saturation and luminance, e.g. using Eqs . (3) - (5). 
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Claims 

1. A method for generating a security docu- 
ment by applying a security pattern to an original image 

5 for generating a modified image, characterized in that 

said security pattern comprises a plurality 
of points, wherein each of said points represents a pat- 
tern value pij and wherein local averages a k are calcu- 
lated from said pattern values for at least some areas k 
10 of said security pattern, and 

wherein for at least some of the points in 
said security pattern the color C-^j of the corresponding 
point of the original image is replaced by a modified 
color C'ij according to 
15 C'ij = f (Cij, pij, a k ) , 

wherein f is a function that depends on at least one lo- 
cal average tx k of an area k said point is located in. 

2. The method of claim 1, wherein said func- 
tion f is such that 

2 0 if m and M are real numbers with m < oc^ < M, 

and wherein C m = f(C-j_j, m, a k ) and C M = f(Cij, M, a k ) , 

and if C^-j. lies within a color space with a 
Euclidean metric and we define R m as the Euclidean dis- 
tance between C m and C-[j and R M as the Euclidean distance 
2 5 between Cjyj and j / 

then for any value p^j in the interval [m, 
M] , the Euclidean distance between C^j and f(Cij, Pi j , 
oc k ) lies within the interval [0, max(R m/ R M ) ] . 

3. The method of one of the preceding claims, 
30 wherein said function f (Cj[ j , Pi j / <*k) is continuous in 

Pi j • 

4. The method of one of the preceding claims, 
wherein said local averages a k are calculated as a 
weighted sum 

35 a k = 2 A k/ ij - Pi j 

wherein A k is a matrix of weights and Z is the sum over 
the points with indices i,j in said area k, and 



14 



wherein said function f has the property 
that, for any color C of said original image in said area 

£ ( A k,ij* f < c ' Pij' <*k>> * C. 

5. The method of claim 4, wherein all ele- 
ments of said matrix A k are equal to 1/N k , wherein N k is 
the number of points in said area. 

6. The method of claim 5, wherein said secu- 
rity pattern comprises a plurality of characters and 
wherein said local areas are rectangular areas, each of 
said rectangular areas enclosing one character. 

7 . The method of one of the preceding claims 
further comprising the step of providing a chromatic 
shift for any given color Cj_j and any local area k, said 
chromatic shift being given by two colors Cj^Cij) and 
Cf(Cij), wherein said function f depends on said cover- 
age-balanced chromatic shift such that 

f (C, Pmin, Ct k ) = C b (Cij) and 

f <C, Pmax' a k) = c f< c ij) and 
for p m i n and p max being the minimum and maximum possible 
pattern values Pi j • 

8. The method of claim 7, wherein 

f(C i;j , Pij, a k ) = Cb(Cij) • (Pij - Pmin) /(Pmax " Pmin) 

+ C f (Cij) • (p max - Pij) / (Pmax - Pmin) 

9. The method of claim 8 further comprising 

the steps of 

choosing a reference shift for a reference 
color K, wherein said reference shift is given by two 
colors and Kf and corresponds to said chromatic shift 
for said color Cij if Cij = K and a k = (p max + Pmin)/ 2 / 

calculating said chromatic shift for any 
other color Cij from said reference shift by transforming 
said two colors and Kf as a function of color Cij and 
said local averages a k . 

10. The method of claim 9, wherein said ref- 
erence color K and said two colors and Kf are arranged 
on a line in an Euclidean, additive color space, wherein 
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K b - k = K - Kf and wherein said step of calculating said 
chromatic shift comprises the steps of 

calculating first corrected colors K b ' and 

Kf' from 
5 K b ' = K b + d 

Kf' = Kf + d 
with 

d = (K f - K b ) • (a k - (p max - Pmin) /2) / (Pmax - Pmin> * 
and calculating said two colors C b (Cij) and 
10 Cf(C-L-j) from said first corrected colors K b ' and Kf ' , 
said reference color K and said color Cj_j . 

11. The method of one of the claims 9 or 10 
comprising the step of calculating said two colors 
C b (Cij) and Cf (Cij) 

15 by correcting the luminance of the chromatic 

shift according to the luminance difference between the 
reference color K and the color j / and/or 

by correcting the hue of the chromatic shift 
according to the hue difference between the reference 
20 color K and the color Cj_ j , and/or 

by correcting the saturation of the chromatic 
shift according to the saturation difference between the 
reference color K and the color Cj_j . 

12. The method of claim 10 or 11 comprising 

25 the step of correcting a CIE-Lab luminance difference be- 
tween said two colors C b (Cj_j) and Cf (C^-j ) to make it 
equal to the CIE-Lab luminance difference between said 
two colors K b and Kf . 

13 . The method of one of the preceding claims 

30 wherein said pattern values are binary having values of 0 
and 1, wherein for a pattern value of 0 the color C^j of 
the corresponding point of the original image is shifted 
in a first direction and for a pattern value of 1 the 
color Cj[j of the corresponding point of the original im- 

35 age is shifted in a second direction, and in particular 

wherein, in a given Euclidean color space, said first di- 
rection is opposite to said second direction. 
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14 . The method of one of the preceding claims 
wherein said original image is a holder's photograph on 
an identity document. 

15. The method of one of the preceding claims 
5 comprising the step of printing the modified image on a 

continuous-tone printer. 

16. A security document obtainable by the 
method of one of the preceding claims. 

17. The security document of claim 16, 

10 wherein said security document is a driving license. 

18 . The security document of one of the 
claims 16 or 17, wherein said pattern is a text repre- 
senting information that is also elsewhere visible on 
said document, and in particular wherein said text is at 

15 least partially encrypted. 
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Abstract 

The described method is used for generating a 
security document by applying a security pattern to an 
5 original image. The security pattern comprises a plural- 
ity of points, wherein each of said points represents a 
pattern value. Local averages are calculated from said 
pattern values for at least some areas of the security 
pattern. For at least some of the points of the security 

10 pattern the color of the corresponding point of the 

original image is replaced by a modified color. The modi- 
fied color is a function of the local average, the origi- 
nal color and the corresponding pattern value. The method 
provides good security against counterfeit because it is 

15 difficult to implement using conventional image process- 
ing applications. For a suitable choice of the color 
transformation function, the resulting image can preserve 
the local color tones of the original image. 
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